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Method and apparatus for storing a stream of data received from a source 

EPO-DG 1 
2 0 12 2002 
® 

The invention relates to a method of storing a stream of data received from a 
source in a memory, the stream of data comprising a stream of audio- visual data and other 
data, the method comprising the steps of storing the stream of data in a memory and 
receiving a pause command. 
5 The invention further relates to an apparatus for storing a stream of data 

received from a source in a memory, the stream of data comprising a stream of audio-visual 
data and other data, the apparatus comprising: means for receiving a memory to store the 
stream of data; means for receiving a pause command; and a central processing unit. 
The invention also relates to a programmed computer. 

10 



Embodiments of such a method and apparatus are known from US patent 
application US 6 404 977. This document discloses a video recorder that comprises an 
automatic pause function. The automatic pause function is triggered upon detection of a 
15 commercial. Upon receiving the pause command, recording of all incoming data is halted. In 
this way, a stream of video data is recorded that does not comprise commercial breaks. 

When only video data is received and recorded, this is no problem. However, 
when additional data is received and recorded with the video data - other data like data 
related to interactive applications like can be provided with the multimedia home platform 
20 protocol - this may lead to problems. 

For example, during the commercial break, data for an application maybe 
broadcasted, an application of which the execution is signalled right after the commercial 
break. When the data is not recorded - because the recording of all incoming data was halted 
- this causes problems, since during replay of recorded data, the data for the signalled 
25 application appears not to be present. 



It is an object of the invention to ensure that all data of applications that are 
triggered to run during reproduction of the stored audio-visual data is stored during recording 
of the audio-visual data. 
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This object is reached with the method according to the invention, 
characterised in that that the method further comprises the steps of pausing the storage of the 
stream of audio-visual data upon reception of the pause command; and continuing the storage 
of the other data. 

By continuing the recording of other data, it is ensured that all data of 
applications triggered (or signalled) to be executed during reproduction of the recorded data 
is stored. 

In an embodiment of the method according to the invention, the other data 
comprises interactive applications that use trigger points in the stream of audio-visual data as 
input and the method further comprises the steps of receiving an unpause command; re- 
commencing the storage of the stream of audio-visual data upon reception of the unpause 
command; and shifting at least one trigger point that is present in the stream of audio-visual 
data that is received while storage of the stream audio-visual data is paused towards a point in 
the stream of audio-visual data that will be stored after re-commencing the storage of the 
stream of audio-visual data. 

During reproduction of a received stream of audio-visual data like a television 
broadcast programme, multiple application may be executed. The output some of the 
different applications may be used as input for further applications. When storage of a stream 
of audio-visual data interrupted, it may be the case that points at which applications are 
triggered to be run are not recorded. This means, that they will not be executed upon 
reproduction of the stored data. When these applications created output, necessary as input 
for the further applications that are run during the reproduction, this may lead to 
inconsistency problems of the further applications. 

By shifting the point at which applications are triggered from a location in the 
audio-visual data that is not stored to a location that is stored, the applications of which the 
output is necessary for the execution of the further applications are executed. In this way, 
consistency of the applications related to the stored audio-visual data is guaranteed, which is 
a great advantage of this embodiment of the invention. 

In a further embodiment of the invention, the other data comprises interactive 
applications that are run during reproduction of the stream of audio-visual data and the 
method further comprises the step of deleting applications that are not run during 
reproduction of the stream of audio-visual data that is stored in the memory. 

When the trigger point for an application is not recorded and the application is 
signalled only once at that specific trigger point, the application will not be signalled during 
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reproduction of the stored stream of audio-visual data, so the application will not be run 
during reproduction of the stored audio-visual data. Therefore, storage of the application has 
no useful meaning and the application can be deleted. 

The apparatus according to the invention is characterised in that the central 
processing unit is conceived to pause a process of storing of the stream of audio-visual data 
upon reception of a pause command and continue the storage of the other data while the 
process of storing of the stream of audio-visual data is paused. 

The programmed computer according to the invention is characterised in that 
the computer is programmed to perform the method according to claim 1. 



These and other aspects of the invention will be elucidated by means of 
figures, wherein: 

Figure 1 shows an embodiment of the apparatus according to the invention; 
Figure 2 shows a flowchart depicting an embodiment of the method according ' 
to the invention; 

Figure 3 shows streams of data with trigger / signal points elucidating an 
embodiment of the method according to the invention; 

Figure 4 shows streams of data with trigger / signal points elucidating a further 
embodiment of the method according to the invention; and 

Figure 5 shows streams of data with trigger / signal points elucidating another 
embodiment of the method according to the invention. 

Figure 1 shows a consumer electronics system 100 comprising a video 
recorder 110 as an embodiment of the apparatus according to the invention, a TV-set 150 and 
a control device 160. The video recorder 1 10 is arranged to record streams of audio-visual 
data and interactive applications associated with those streams of audio-visual data carried by 
a signal 170. 

To this, the video recorder 1 10 comprises a receiver 120 for receiving the 
signal 170, a de-multiplexer 122, a video processor 124, a micro-processor 126 for 
controlling components comprised by the video recorder 1 10, a storage device 128, a 
programme code memory 130, a user command receiver 132 and a central bus 134 for 
connecting components comprised by the video recorder 1 10. 
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The receiver 120 is arranged to tune in to a television channel and derive data 
of that television channel from the signal 170. The signal 170 can be received by any known 
method; cable, terrestrial; satellite or any other method of distributing audio-visual data. The 
signal 170 can even be derived from the output of another consumer electronics apparatus. 
5 In the preferred embodiment, the data derived from the signal 170 complies 

with the DVB standard and carries MHP data with it. DVB is the European standard for 
digital video broadcasting and MHP - multimedia home platform - is a standard for 
interactive applications on the DVB platform. More information can be found on 
http://www.dvb.org. 

1 0 As will be apparent to any person skilled in the art, the data derived from the 

signal 170 may just as well comply with another standard for digital video distribution like 
DASE. Li yet a further embodiment, the data may received is analogue. In that case, the 
receiver 120 comprises an analogue to digital converter for converting the analogue data to 
digital data. 

1 5 The data derived from the signal 1 70 and selected by the receiver 120 is 

transferred to the de-multiplexer which is arranged to split the received data in a stream of 
audio-visual data and data related to interactive applications or other meta-data related to the 
stream of audio-visual data. The latter data will in the course of the description be referred to 
as interactive data, although the invention is not limited to this. 

20 The stream of audio-visual data may be further processed by the video 

processor 124 in order to provide a signal compliant to the input standard of the TV-set 150 
for reproduction of the audio-visual data on the TV-set 150. The stream of audio-visual data 
may just as well be stored in the storage device 128 for later reproduction, depending on user 
input commands. 

25 In the preferred embodiment, the storage device 128 is a harddisk drive. 

However, as will be recognised by any person skilled in the art, the storage device 128 may 
just as well be an optical disk, a solid state memory or any other kind of storage device. 

The interactive data derived by the de-multiplexer 122 is processed by the 
micro-processor 126 or stored in the storage device 128 for later processing. When the 
30 interactive data is processed, the output is send to the video processor 124 for multiplexing it 
with the audio-visual data for reproduction by the TV-set 150. 

Operation of the video recorder 1 10 is controlled by the micro-processor. This 
is done upon receiving commands from a user through control device 160, of which 
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command are received by the user command receiver 132. This is also done upon receiving 
command or programme code from the programme code memory 130. 

Control data, audio-visual data and interactive data flow from the various 
components of the video recorder 1 10 over the central bus 134 or by direct links between the 
5 components. 

In operation of known video recorders, a user is enabled to record a stream of 
audio-visual data like for example a television programme. In this process, the data selected 
by a built-in tuner is stored in a storage device like tape or DVD+RW. In the most simple 
embodiment, this operation is started by pressing a 'record' button on a control device of the 
10 video recorder. 

Applying this straightforward to the video-recorder 110, this would mean that 
data received by the receiver 120 would be stored in the storage device 128. In this way, a 
stream of multiplexed audio-visual and interactive data is stored. 

During the recording process, a pause button 162 can be pressed to suspend 
15 recording of the data. When this process would be suspended using a method according to the 
prior art, storage of audio-visual data as well as interactive data is suspended. This is because 
the interactive data is multiplexed with the audio-visual data. 

However, when during suspension of the recording process interactive data is : 
received that maybe used by an interactive application that is run during reproduction of 
20 audio-visual data that is recorded after re-commencing the recording process, this may lead to 
problems since data of the application is missing. 

Therefore, the invention proposes to keep recording the interactive data — or 
any other data other than audio-visual data — when the recording process is suspended and 
only suspend the recording of audio-visual data. Of course, this implies that the received data 
25 has to be parsed or de-multiplexed first in audio-visual data and interactive data. 

A preferred embodiment of method according to the invention will be 
described referring to Figure 1, Figure 2 and Figure 3. Figure 2 shows a flowchart 200 
representing an embodiment of the method according to the invention. Figure 3 shows 
received data 300 and recorded data 350, both comprising a stream of audio-visual data and 
30 interactive data. 

The process starts by receiving a recording command in a startpoint 202. In 
the most simple embodiment, this operation is started by pressing a 'record* button 161 on 
the control device 160. Of course, other ways of starting the recording processes are known 
and can be applied without departing from the scope of the invention. 
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Subsequently, all received data 300 from a channel to which the receiver 120 
is tuned in is recorded, i.e. stored in the storage device 128 during a process step 204. The 
received data 300 is built up from received interactive data 310 and received audio-visual 
data 320. The interactive data 310 is grouped as an object carousel, whereas the audio-visual 
data 320 is provided as a stream. 

In the process step 204, the interactive data is stored as stored interactive data 
260 and the received audio-visual data 320 is stored as stored audio-visual data 370. 

While recording the data, the video recorder waits for an input command in a 
waiting loop comprising a waiting step 206 and a decision 208. When the command received 
is no pause command, the process stays in the loop and goes to the waiting step 206 again. 
When the command received is a pause command, the flowchart 200 continues to a process 
step 210. 

In the process step 210, the recording of the received audio-visual data 320 is 
halted. Referring to Figure 3, this is indicated by a first mark 321 in the received audio-visual 
data 320. However, the recording of the interactive data is continued. 

The process step 210 is followed by another waiting loop, comprising a 
waiting step 212 in which the video recorder 110 waits for a command to continue the 
recording process that was started in the start point 202 and further comprising a decision 214 
in which the input command is checked. 

When the input command is an unpause command, the process depicted by the 
flowchart 200 continues by recommencing the recording of the received audio-visual data 
320 in a process step 216. The moment of recommencing the recording of the received audio- 
visual data 320 is indicated by a second mark 322. 

The result of this process is that the stored audio-visual data 370 has a 
discontinuity indicated by a third mark 371 and that the stored audio-visual data 370 is less 
than the received audio-visual data 320, as indicated in Figure 3. The stored interactive data 
360 is the same as the received interactive data 310. During the recording process, 
redundancy caused by the carousel nature of the received data may be removed, but 
essentially, the stored interactive data comprises the same information as the received 
interactive data. 

Advantages of the use of this method will come apparent from the following 
description. The received audio-visual data comprises a trigger point 323 for the start of an 
interactive application. The data for this application is comprised in an object transmitted in a 
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carousel 312; other blocks in the received interactive data 310 indicate other versions of 
carousels or other objects. 

When together with suspending recording of the received audio-visual data, 
the recording of the received interactive data would be suspended as well and the information 
in the carousel 3 12 would not be fully recorded. This would lead to problems when 
reproducing the television programme from the storage device 128. When the TV-set 150 or 
the video recorder 1 10 encounters the trigger point 323, it tries to execute an application of 
which data is comprised by the carousel 3 12. However, when the carousel 3 12 is not fully 
recorded, this would lead to problems. These kind of problems are solved by the method 
according to the invention. 

The recording process is ended by a stop command in a terminator 218. It will 
be apparent to any person skilled in the art that me recording might be stopped all along the 
process depicted by the flowchart 200 at a stop command. For reasons of clarity, however, 
this has not been indicated in the flowchart 200. 

Further embodiments of the invention will be described with reference to 
Figure 4 and Figure 5. 

Figure 4 shows received data 400 comprising received interactive data 410 and 
received audio-visual data 420. The received interactive data comprises a carousel 412. The 
received audio-visual data comprises trigger point 423 at which an application is started of 
which data is comprised in the carousel 412. 

Figure 4 further shows stored data 450 comprising stored interactive data 460 
and stored audio-visual data 470. The stored data 450 is a result of recording the received 
data 400, halting the recording process at the point indicated by a first mark 421 and 
recommencing the recording process at a point indicated by a second mark 422, leading to a 
discontinuity in the stored audio-visual data 470 indicated by a third mark 471. 

Due to the pause process, the trigger point 423 is not recorded. This may be 
ok, but may just as well lead to inconsistency of other applications that will be executed, 
since their execution is dependent on the execution of the application triggered by the trigger 
point 423. 

Therefore, it may be desirable to execute the application triggered by the 
trigger point 423 anyway during reproduction of the stored data 450. To make this happen, 
the trigger point 423 is translated to a shifted trigger point 473 in the recorded audio-visual 
data. Preferably, the shifted trigger point 473 is inserted after the discontinuity indicated by 
the third mark 471. 
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In a further embodiment of the invention, execution of an application, which is 
signalled to execute during the part of the recording that is paused (that is, of which audio- 
visual data is not stored) is not desirable. For example, when the application is signalled to 
execute at a point half an hour or even more back in time from the point where the unpause 
5 command is given, it is likely that it is related to another programme than the programme that 
is recorded when giving the unpause command. It would be inconvenient for a user to be 
presented with an application related to a first programme while viewing a second 
programme. 

When the execution of such an application is not desirable, the data does not 
10 have to be recorded either. Figure 5 shows received data 500 comprising received interactive 
data 510 and received audio-visual data 520. The received interactive data comprises a 
carousel 512. The received audio-visual data comprises a trigger point 523 at which an 
application is started of which data is comprised in the carousel 512. 

Figure 5 further shows stored data 550 comprising stored interactive data 560 
15 and stored audio-visual data 570. The stored data 550 is a result of recording the received 
data 500, halting the recording process at the point indicated by a first mark 521 and 
recommencing the recording process at a point indicated by a second mark 522, leading to a 
discontinuity in the stored audio-visual data 570 indicated by a third marker 571 . 

Due to the pause process, the trigger point 523 is not recorded. This means 
20 that the application that is signalled to start executing at a point 523 is not executed upon 

reproduction of the stored audio-visual data 570. In this example, the carousel 512 comprises 
only one application, which is the application of which execution is signalled to start at the 
point 523. 

As mentioned, since the trigger point 523 does not occur in the recorded 
25 audio-visual data 570, it does not trigger that application. This means that storage of the 
carousel 512 is not necessary, since it does not comprise vital data for consistency of 
applications related to the stored audio-visual data 570. Therefore, according to a further 
embodiment of the invention, the data carousel 512 is deleted after the recording process. 
This is advantageous, since less storage space is used. 
30 As will be apparent to any person skilled in the art, many variations on the 

preferred embodiments described are possible, without departing from the scope of the 
invention. 
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For example, the audio-visual data may be presented in an analogue format 
like PAL or NTSC and the data other than audio-visual data can be teletext. Also, the other 
data can comprise content description data like MPEG-7 or TV-Anythne. 

Furthermore, the audio-visual data and the data other than the audio-visual 
5 data associated with said audio-visual data do not necessarily have to be multiplexed; they 
may just as well be received through separate channels. For example, the audio-visual data is 
received over cable, whereas the other data is received over the internet through a DSL 
connection. For this, an additional receiver is needed, but the de-multiplexer is obsolete. 

In the preferred embodiment, the apparatus according to the invention is a 
10 dedicated video recorder. A further embodiment of the apparatus according to the invention 
may just as well be a programmed multi-purpose personal computer, conceived to perform 
the method according to the invention. In this further embodiment, the programme code 
memory 130 (Figure 1) is a computer programme product like a CD-ROM, a DVD-ROM of 
a harddisk. 

15 As described here, the pause command is initiated by a user pressing a pause : 

button. However, in yet a further embodiment of the invention, the pause command is given 
by an embodiment of the apparatus according to the invention. This may be because meta- * 
data of the received data indicates that the content of the audio-visual data has changed and is 
not desired by a user (heavy violence, discrimination). 

20 In the description of the preferred embodiments, embodiments have been 

shown where there is a trigger point in the stream of audio-visual data for triggering the 
execution of an application. This does, however, not mean that the trigger point is necessarily 
incorporated in the stream of audio-visual data. The stream may be accompanied by a table 
with references to the stream, indicating at which point in the reproduction process an 

25 application should be run. During reproduction of the stored data, the table is processed and 
when a point at which an application should be run, the application is signalled to execute. 
The invention maybe summarised as follows: 

State of the art video recorders are equipped with a pause function. This 
function may be used in play and record mode. When used in record mode, no data is 

30 recorded. This is ok when only audio and/or video are recorded. However, when other data 
like interactive applications are recorded as well, this may lead to problems when recording 
of an application is interrupted and this application is called upon in a fragment of video that 
is recorded after resuming recording of audio and/or video. The invention proposes when the 
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record function is suspended using a pause function, only recording of audio and/ or video is 
suspended and recording of other data is continued. 
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1 . Method of storing a stream of data received from a source in a memory, the 
stream of data comprising a stream of audio-visual data and other data, the method 
comprising the steps of: 

(a) storing the stream of data in a memory; and 

(b) receiving a pause command; 

(c) characterised in that the method further comprises the steps of: 

(d) pausing the storage of the stream of audio-visual data upon reception of the pause 
command; and 

(e) continuing the storage of the other data, 

2. Method according to claim 1 , wherein the other data is multiplexed with the 
stream of audio-visual data and the method further comprises the step of parsing the stream 
of data. 



3. Method according to claim 2, wherein the data in the stream is split in the 
stream of audio-visual data and other data and the audio-visual data is stored apart from the 
other data in the memory. 

4. Method according to claim 1, wherein the other data comprises interactive 
applications that use trigger points in the stream of audio-visual data as input and wherein the 
method further comprises the steps of: 

(a) receiving an unpause command; 

(b) re-commencing the storage of the stream of audio-visual data upon reception of the 
unpause command; and 

(c) shifting at least one trigger point that is present in the stream of audio-visual data that is 
received while storage of the stream audio-visual data is paused towards a point in the 
stream of audio-visual data that will be stored after re-commencing the storage of the 
stream of audio-visual data. 
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5 - Method according to claim 1, wherein the other data comprises interactive 
applications that are run during reproduction of the stream of audio-visual data and the 
method further comprises the step of deleting applications that are not run during 
reproduction of the stream of audio-visual data that is stored in the memory. 

5 

6 - Method according to claim 1, wherein the stream of data is a DVB transport 
stream 



7. Method according to claim 1, wherein the other data comprises applications 

1 0 according to the MHP standard. 

8 - Method according to claim 1, wherein the pause command is generated by a 

processing unit, comprised by an apparatus conceived to carry out the method according to 
claim 1. 



15 



20 



9. Method according to claim 1, wherein: 

(a) the other data comprises redundant information; and 

(b) during pausing the storage of the audio-visual data the redundant information in the other 
data is removed while storing the other data. 



10 - Apparatus for storing a stream of data received from a source in a memory, the 

stream of data comprising a stream of audio-visual data and other data, the apparatus 
comprising: 

(a) means for receiving a memory to store the stream of data; 
25 (b) means for receiving a pause command; and 

(c) a central processing unit 

characterised in that the central processing unit is conceived to: 

(d) pauseaprocess of storing of the stream of audio-visual data upon reception of a pause 
command; and 

30 (e) continue the storage of the other data while the process of storing of the stream of audio- 
visual data is paused. 



1 1 . Programmed computer, characterised in that the computer is programmed to 

perform the method according to claim 1 . 
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12. Computer programme product for programming a computer enabling the 

computer to perform the method according to claim 1. 



14 EPO - DG 1 10.12.2002 

2 0 12. 2002 
<§> 

State of the art video recorders are equipped with a pause function. This 
function may be used in play and record mode. When used in record mode, no data is 
recorded. This is ok when only audio and/or video are recorded. However, when other data 
like interactive applications are recorded as well, this may lead to problems when recording 
5 of an application is interrupted and this application is called upon in a fragment of video that 
is recorded after resuming recording of audio and/or video. The invention proposes when the 
record function is suspended using a pause function, only recording of audio and/ or video is 
suspended and recording of other data is continued. 
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